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Abstract 

This paper studies complexity of recognition of classes of bounded configurations by 
a generalization of conventional cellular automata (CA) — finite dynamic cellular 
automata (FDCA). Inspired by the CA-based models of biological and computer 
vision, this study attempts to derive the properties of a complexity measure and of 
the classes of input configurations that make it beneficial to realize the recognition 
via a two-layered automaton as compared to a one-layered automaton. A formalized 
model of an image pattern recognition task is utilized to demonstrate that the 
derived conditions can be satisfied for a non-empty set of practical problems. 

Key words: Finite dynamic cellular automata; Complexity measures; Image 
pattern recognition; Biologically-motivated computer vision 



1 Introduction 

Multi-scale image processing techniques have been finding natural implemen- 
tations in hierarchical pyramid/neural networks [15], cellular neural networks 
[2,3,8,12], CA-based models [4,11,14], including probabilistic cellular automata 
[1]. Cellular automata have also been adapted to serve as a model of certain 
functions of primary visual cortex [10]. The fact that such applications of CA 
are concerned with input configurations of bounded size limits the usefulness 
of conventional CA complexity measures that do not take into account prop- 
erties of individual cells (e. g. size of the basic neighborhood). For example, an 
arbitrary class of input configurations of bounded size can be recognized (in 
the sense defined in section 2.2) by a cellular automaton in a single step of the 
computation by means of using a basic neighborhood of a large enough size to 



Preprint submitted to Elsevier Science 



1 February 2008 



fully cover the area of the input configurations. Obviously, this implementa- 
tion is not the one preferred in computer vision and biological vision systems. 
Instead, multilayered designs are utihzed in a wide range of image processing 
algorithms [13], as well as in biological vision systems [5]. What properties of 
the complexity measures of the visual systems result in efficiency of the mul- 
tilayered approach? What properties of bounded configuration classes make 
them efficiently recognizable by multilayered CA? These are the two questions 
we address in this paper. 



One immediate explanation of a potentially faster performance of a multilay- 
ered structure is its straightforward parallelization guaranteed by functional 
independence of the cells of the same layer. This paper, however, shows that 
the speedup can be achieved even with a sequential model of computation. 



One of the complications of adapting a conventional CA to a real-life recogni- 
tion apphcation arises from the fact that the cells of a conventional CA have 
a fixed functionality at every step of the computation. While this property 
of CA is suitable for representation of hardware arrays of processing units 
[7,16,17], this is an artificial constraint for software implementations and for 
modelling of biological systems where neuron layers of different functionalities 
realize step- wise processing. To overcome this constraint, in section 2.1 we 
define a generalization of CA, a dynamic cellular automaton (DCA) and its 
finite version, a finite dynamic cellular automaton (FDCA). DCA is different 
from the structurally dynamic cellular automata introduced in [6] in that the 
local map and basic neighborhood of DCA arc preprogrammed for each step 
of the computation, as opposed to being derived on-the-fly. 



The finiteness of FDCA allows the definition of its complexity measure in 
terms of the complexity of realization of each cell. It is shown that a more 
detailed analysis of the complexity measure, than the one that involves input 
size only, is necessary to account for potential reduction of complexity via 
multilayered processing. Such analysis is done with the use of the cardinality 
of the class of local configurations recognized which is treated as a charac- 
teristic of the partitioning of all possible local configurations that is induced 
by the local map. The conditions for the two- layered FDCA to be preferred 
over one-layered FDCA are derived. These conditions relate sizes of the basic 
neighborhoods, the size of the input configurations, the cardinality of the class 
of local configurations recognized (section 3). Finally, a model of a common 
image filtering task satisfying these conditions is presented in section 4. 
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2 Definitions 



2.1 Finite dynamic cellular automata 



The following definition of FDCA is based on the definition in [10,11]. 

Definition 1 We define a dynamic cellular automaton (DC A) as an infinite 
set A of layers a-i, A = {(To, ci, . . . }, where ai = {d, ki, N^, /j). Here d denotes 
the dimension of the infinite grid of cells C — li^ . Every cell of the layer i can 
assume states from a finite set = {0, 1, . . . , /cj — 1}, ki>2 of possible states 
that is called the alphabet of the layer i automaton. The function fi : S^;^ — > Ej 
is the local map of the layer i automaton. For the sake of simplicity we assume 
that the basic neighborhood Ni of the local map of layer i, is of form Ni ~ 
[-ri,i,ri,i] X [-ri,2,ri,2] x • • • x [-ri^d,ri,d] C Z'^, where rij > l,j = 1, . . . ,d. 
Local map and basic neighborhood of layer are not defined. 

We call a map Xi : C ^ Tii from the set C of all cells to the alphabet of 
layer i a confi,guration of the respective layer the dynamic cellular automaton 
and denote as Xi the space of all possible configurations of this layer. Local 
map fi induces the global map Fi : Xi_i — * X^. For a particular configuration 
Xi and a cell c E C we define the local configuration Xi^c o,t c as the map 
Ni+i — > Ej, such that Xi^d^) = Xi{c + z). Now we can define the global map 
Fi as Fi{Xi^i){c) = fi{xi-i,c)- 

For the purpose of recognition of classes of bounded configurations it is useful 
to consider a finite subset of the grid of cells C of DC A. 

Definition 2 A finite dynamic cellular automaton (FDCA) is a DCA with a 
distinguished finite subset of cells W G C that is called the working zone of 
the FDCA. Without loss of generality we shall assume that W = [wi] x [W2] x 
• • • X [wd], where [w] is the set {1,2, ... ,w}. 

Using both finite cellular automata and finite dynamic cellular automata one 
has to face the following technical difficulty: the local map cannot be apphed 
to cells close to boundary of the working zone. There are known a few possible 
solutions to this problem for finite cellular automata. One of the solutions is to 
use cyclic boundary conditions, i. e. glue together opposite ends of the working 
zone. The approach used in this paper is to adopt fixed boundary conditions 
and assume that the missing cells are in some special state. 
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^.2 Recognition 



Definition 3 We shall say that a FDCA A recognizes a class of input con- 
figurations D C Xq by the cell c & W of layer i, when there is a state A; e Ej 
of the cell c such that 

Xi{c) = kijfXoeD. 

Similarly when referring to a cell c of layer i > 1 of a FDCA we can talk about 
recognition of a class of local configurations E C Nf^~^ of the preceding layer 
i — 1, when there is a state k El^i such that 

Xi{c) = fi{xi_i^c) = k iffxi_i^c e E. 

2.3 Special cases 

Further we restrict our attention to two special cases of FDCA: 1-layered and 
2-layered FDCA. 

Definition 4 We shall call a FDCA A a 1-layered FDCA if there is a cell 
c eW such that c + Ni = W , where Ni is the basic neighborhood of layer 1. 
Similarly, we call a FDCA A a 2-layered FDCA if there is a cell c E W such 
that c + = W, where N2 is the basic neighborhood of layer 2. 

The conditions below further restrict the types of FDCA investigated in this 
paper: 

• dimension d of the FDCA is 2, 

• basic neighborhoods are squares: Ni — [—ri,rif, 

• working zone is a square: W = [w]'^, 

• all alphabets are binary: Ej = {0, 1}. 

Remcirk 5 Since at the top layer of a FDCA there is at most one cell par- 
ticipating in recognition of a given class of configurations, we set its local 
neighborhood equal to the working zone W and ignore the rest of the cells of 
this layer. 

2.4 Complexity 
2.4.1 Cell complexity 

We define a complexity of recognition of a class of input configurations D by 
a FDCA A in terms of the complexity of its individual cells. 
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Definition 6 We denote the complexity of a cell c G W of layer i as a func- 
tion L{n,p), where n is the size of the basic neighborhood, n = \Ni\, and p is 
the cardinality of the class x' of local configurations recognized by the cell c, 

p = \x'\, x' = {Xi_i^c ■ fi{Xi-l,c) = 1}- 

Assumption The strong assumption we make about the complexity func- 
tion L{n,p) is tliat it is monotonically increasing with respect to n and p. 
While it is natural to assume monotonicity of a complexity measure on the 
size of the input n, many real-life complexity measures are not monotone 
with respect to the cardinality of a partition class p induced by a map on 
its domain. For example the length of the canonical DNF (disjunctive normal 
form) is monotone w.r.t. p, while the minimum of the lengths of canonical 
DNF and canonical CNF (conjunctive normal form) is not monotone w.r.t. 
p [18,19]. However, for many complexity measures (including the minimum 
of the lengths of canonical DNF and canonical CNF) it is possible to specify 
the reasonable range of p for which this measure is monotone. Further we will 
assume that p is always within the range of monotonicity of L{n,p). 

2.4.2 Complexity of FDCA 

Consider a 1-layered FDCA Ai with the working area W that recognizes a 
class of input configurations D hy a, layer 1 cell c. Let N be the size of the 
input for a cell of layer 1, then = \Ni\ — \W\ due to remark 5. Let Pi be 
the cardinality of the class of configurations recognized by a cell of layer 1, 
Pi = \D\. 

From the definition of cell complexity (definition 6), assuming that the cells 
within the same layer of FDCA run sequentially and ignoring the cells that 
do not participate in recognition (all but one cell of layer 1), we can derive 
the expression for the sequential time complexity of Ai- 

X{Ai)^L{N,Pi). (1) 

Since for a 1-layered FDCA there is only one cell that participates in the 
recognition, the parallel time complexity of Ai is equal to its sequential time 
complexity: 

li{Ai) = L{N,Pi). (2) 

Similarly, we can derive the expressions for the sequential and parallel time 
complexities of a 2-layered FDCA. Consider a 2-laycrcd FDCA A2 with the 
working area W that recognizes a class of input configurations D by the layer 
2 cell c. Let N be the size of the input for a cell of the layer 2, then N = 
IA2I = \W\ due to remark 5. Let P2 be the cardinality of the class of local 
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configurations of layer 1 recognized by the cell c of layer 2, P2 = \{xi^c '■ 
/2(2^i,c) = 1}|, let p be the cardinality of the class of local configurations of 
layer recognized by a cell of layer 1, p = |{xo,c' : /i(a:^o,c') = 1, c' G W}\, and 
let n be the size of the input for a cell of layer 1, n = |iVi|. 

We can express the sequential time complexity of A2 as 

X{A2)^N-L{n,p) + L{N,P2). (3) 



Assuming that the cells of the same layer run in parallel, the parallel time 
complexity of A2 is 

f,{A2)^L{n,p)+L{N,P2). (4) 



2. 5 Speedup 



Definition 7 We shall say that the recognition of a class of configurations D 
allows speedup via decomposition with respect to the cell complexity measure 
L and sequential time complexity \, if there exist a 1-layered FDCA A\ and 
a 2-layered FDCA A2 that both recognize D and 

^^0. N^^. (5) 



Automaton A2 is then said to achieve the speedup over Ai- 

Similarly, we can define the speedup with respect to cell complexity measure 
L and the parallel time complexity 



3 Conditions for speedup 



In this paper we shall concern ourselves with the speedup w.r.t. sequential 
time complexity A. 

Theorem 8 In the notation of sections 2.4 and 2.5, FDCA A2 achieves the 
speedup over FDCA Ai (w.r.t. X-complexity) in recognition of class of config- 
urations D iff the following two conditions are satisfied (N — > 00): 
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CI : 

C2: 



HN,P^) 
N ■ L{n,p) 



0, 



(6) 
(7) 



PROOF. Directly follows from (1), (3), (5) and the fact that L{y,z) > 
provided z > 0, and Pi, P2, P are all positive (this holds for nontrivial classes 
of configurations) . □ 

Remark 9 Condition CI immediately implies that the cell complexity mea- 
sure L{y, z) should essentially depend on its second argument z, the cardinality 
of the class of configurations recognized by the cell at a particular layer. 

Corollary 10 Let L{y, z) ~ ©(z") for some a > 0, L(y, z) is monotonically 
increasing w.r.t. y, z, then 

(a) CI is satisfied iff 

^ ^ 0, (8) 

(b) for C2 to be satisfied, it is sufficient that 



PROOF, (a) Immediately follows from the asymptotics L{y, z) — Q{z"') and 
the definition of CI. 

(b) Since L(|/, z) is monotone on 

L{N,P,) _^ L{N,P,) 

y 00 ^T* y 00 

N-L{N,p) N-L{n,p) 
L(N, Pi) I (N ■ L(N, p))^oo^ Pi7(A^p«) ^ 00 <^ p = o (Pi/N^l^) . □ 



4 Example of speedup 



In this section we design a class of configurations and respective 1- and 2- 
layered FDCA recognizing the class that satisfy conditions CI and C2 for the 
speedup. 

Definition 11 Consider a particular type of angular pattern on the square 
grid of area n such that ^Jn is odd. An example of the corresponding local con- 
figuration X of area n = 25 is shown in figure 1. Denote as x' the class of all lo- 
cal configurations within the Hamming distance ofl from x, x' — {x : d{x, x) < 
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Fig. 1. A local configuration corresponding to the angular pattern in Definition 11 
(Shaded cells are in state 1, the others are in state 0). 

1)}. For a working zone W of a size N > n we shall define a class of input con- 
figurations X' , X' = {X : X includes exactly one instance of a pattern fromx'}. 
Let us denote quantities \x'\ = n + 1 as p, and \X'\ as Pi. 

RemcLrk 12 Informally, class X' consists of all the configurations that have 
a single occurrence of the angular pattern that is specified with the accuracy of 
up to one possible error (thus the Hamming distance ofl). 

Further we shall be concerned with the problem of recognition of the class of 
input configurations X'. Let us specify two FDCA recognizing X'. 

We shall denote the one-layered FDCA that recognizes X' as ^i. As is easy 
to see 

X(Ai)^L(N,Pi). (10) 

The two-layered FDCA A2 that recognizes X' is defined so that cells of its first 
layer recognize x' via the local map from the basic neighborhood of size n and 
the cell of its second layer recognizes the class of configurations X" = {X : 
X has exactly one cell in state 1}. If i? is the number of cells of layer 2 that 
fall under the fixed boundary condition mentioned in 2.1, then \X"\ — N — B 
— the quantity that we will denote as P2. Note that 

X{A2)=N-L{n,p) + L{N,P2). (11) 

Proposition 13 Let L(y, z) — Q{z°') for some a > 0, L{y, z) is monotoni- 
cally increasing w.r.t. y, z, and n = 0{N^/^"'). The recognition of the class of 
configurations X' allows speedup via decomposition. 



PROOF. To prove the statement of the theorem it is sufficient to show that 
A\ and A2 realize the speedup. This will be done via Theorem 8, namely we 
shall show that Ai and A2 satisfy conditions CI and C2. 

Condition CI is satisfied if P2/P1 — > 0. To prove the latter limit, let us 
construct a superlinear lower bound on size of Pi, bearing in mind that P2 — 
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N — B. A simple estimate of number of possible configurations in X' yields 

Pi> {N - B){n + 1){N -n-2)\ (12) 
which is sufficient for our purpose. 

To prove C2 using the property of monotonicity of function L{y,z) it is suffi- 
cient to show that 

^ ^ 0, (13) 
which follows from (12), p — n + 1 and the condition of the theorem. □ 



5 Conclusion 



We derived the conditions for a 2-laycred FDCA to be more efficient (w.r.t the 
sequential time complexity measure) than a 1-layered FDCA, under the as- 
sumption that the cell complexity is polynomial on the cardinality of the class 
of configurations being recognized. This assumption holds for some complex- 
ity measures, such as the length of the canonical DNF, and it has plausibility 
regions for others, such as minimum of the lengths of the canonical DNF and 
CNF. A real-life image pattern recognition problem is formalized and is shown 
to allow the speedup via utilization of a 2-layered FDCA. 

Among the interesting problems that remain to be solved we mention improve- 
ment of the sufficient conditions of the speedup, and investigating speedup 
with respect to other plausible cell complexity measures. 
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